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1 Introduction 



The Merton problem - a question about optimal portfolio selection and con- 
sumption in continuous time - is indeed ubiquitous throughout the mathe- 
matical finance literature. Since Merton's seminal paper [16] in 1971, many 
variants of the original problem have been put forward and extensively stud- 
ied to address various issues arising from economics. For example, Fleming 
and Hernandez-Hernandez pTj considered the case of optimal investment 
in the presence of stochastic volatility. Davis and Norman J6j, Dumas and 
Luciano [8], and more recently Muhle-Karbe and co-authors [5], [I3], [17] ad- 
dressed optimal portfolio selection under transaction costs. Rogers and Sta- 
pleton [20] considered optimal investment under time-lagged trading. Vila 
and Zariphopoulou [22] studied optimal consumption and portfolio choice 
with borrowing constraints. The effects of different types of habit formation 
on optimal investment and consumption strategies have been explored in [3] , 
[H], and [ig. 

A particular class of constrained optimal investment problems that forms 
an important and recurring theme in mathematical finance is optimal in- 
vestment under a drawdown constraint. This constraint, roughly speaking, 
means that a certain parameter has to remain above a fixed proportion of the 
running maximum of its past values. Drawdown constraints on wealth have 
been studied by Elie and Touzi [10], and Roche [19]. Carraro, El Karoui, 
and Obloj [1], and Cherny and Obloj [2] studied drawdown constraints in 
more general semimartingale settings via Azema-Yor processes. Grossman 
and Zhou [12] considered the problem of maximising the long-term growth 
rate of expected utility of final wealth, subject to a drawdown constraint. 

The case we consider in this paper is the Merton problem with a draw- 
down constraint on consumption. Under this condition, the investor cannot 
let consumption fall below a fixed proportion of the running maximum of 
past consumption. In mathematical terms, we have that our consumption at 
time t, Ct, satisfies 

Ct > b sup Cs = bct 

0<s<t 

for a fixed proportion < 6 < 1. 

In terms of economic motivation, this represents a type of habit formation 
where once the investor has reached a certain standard of living, he is re- 
luctant to let his standard of living to fall too far from that level. Clearly, 
the case 6 = is just the standard Merton problem, and taking 6 = 1 gives 
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the special case where consumption is constrained to be non- decreasing. The 
6=1 case was investigated by Dybvig in 1995, and hke the standard 
Merton problem it is possible to obtain an explicit solution in this case. 
However, taking < 6 < 1 gives a continuum of cases between these two 
extremes where the parameter 6 in a sense represents the willingness of the 
investor to sacrifice a proportion of his current standard of living in exchange 
for greater utility in the long-run. 

To be precise, we consider an agent who can invest in a risk-free bank account 
and a risky stock modelled by geometric Brownian motion. The agent seeks 
to maximise the expected infinite horizon discounted utility of consumption 
by finding the optimal portfolio selection and consumption strategies - sub- 
ject to the drawdown constraint on consumption. 

We work with CRRA utility and consider the dual formulation of the prob- 
lem. The dual problem is significantly easier to handle and has an explicit 
analytic solution. We invert this to obtain our candidate value function and 
optimal controls. To prove optimality, we modify the approach of Dybvig 
[9] (who considered the case where consumption is non-decreasing). The key 
parameter in this problem is the ratio of the investor's wealth to the running 
maximum of past consumption. For the optimal solution, we observe four 
different regions of behaviour based on the value of this parameter. For low 
values, consumption is restricted to the minimal level possible without violat- 
ing the drawdown constraint. As the ratio increases, consumption increases 
with wealth. In the third region, we consume at the highest recorded level of 
consumption to date while we wait for the ratio to hit a critical level, after 
which we increase consumption to a new maximum. We specify the bound- 
aries of these regions explicitly, as well as the optimal portfolio selection and 
consumption rules in each case. 

This paper is organised as follows. In section |2l we outline the market model 
that we will be working in. In sections |3] and HI we provide an informal but 
intuitive derivation of the value function and optimal controls for R ^ 1 and 
R = 1, where R represents the investor's coefficient of relative risk aversion. 
Section [5] provides a rigorous verification argument to prove the optimality of 
our conjectured solution. Finally, in section [6l we give an argument to show 
that, just like in the standard Merton problem, the case we consider here is 
ill-posed for R < R* for a certain < -R* < 1 which we specify. 
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2 Market model 



We work in the framework of the standard Merton problem. Formally, we 
have a risk-free bank account with constant interest rate, r, and a risky stock, 
S, with price dynamics given by 

dSt = StiadWt + jjdt) 

for constant volatility, a, and constant drift, /i, where {Wt)t>o is a standard 
Brownian motion. Thus our wealth evolves according to the following wealth 
equation 

dwt = rwtdt + 9t{adWt + {fi — r)dt) — Ctdt (1) 

where 

Wt = our wealth at time t 
Ct = our consumption at time t 
9t = the wealth in the stock at time t. 

To make the stock attractive to the investor, we assume that fi > r. We also 
take r > (so we exclude to zero interest rate case) which will in fact turn 
out to be a necessary condition for the existence of a solution, as shown in 
Corollary [1] 



We want to maximize the expected infinite horizon discounted utility of con- 
sumption 



E 



e-f"U{ct)dt 



subject to a drawdown constraint on consumption 

Ct > bct = b sup Cs 

s<t 



(2) 



(3) 



for some < b < 1. Note that taking 6 = gives the standard Merton 
problem [16] and taking 6=1 gives the non-decreasing consumption case 
considered by Dybvig [H] . One can check that the analysis put forward in this 
paper simplifies to the solutions given by Merton and Dybvig for 6 G {0, 1}, 
but to avoid denegerate cases we will restrict our attention to < 6 < 1. 



We take the agent's utility function, U, to be of constant relative risk aver- 
sion (CRRA), that is U{x) = for R I, and U{x) = logx for R = 1, 
where i? is a positive real number which represents the investor's coefficient 
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of relative risk aversion. However, for the problem to be well-posed we need 
to choose R such that 7a/ > where 



(4) 



and K = This is equivalent to taking R > R* for a particular < i?* < 1 
given by 



R* = — 
2r 



(5) 



In section [6l we will show that, as in the standard Merton problem, if we do 
not have this condition then it is possible to find strategies that give infinite 
expected utility. 



Lastly, we insist that our investment and consumption strategy, {6,c), is 
admissible i.e. Wt > almost surely for all t > 0. 

In the next section, we will give a systematic but, in some places, informal 
derivation of the value function and optimal controls for R ^ 1. To avoid 
confusion, we defer the R = 1 case until section |H A rigorous verification 
argument is given in section |5l 



3 Identifying the optimal controls and the 
value function for R ^ 1 

We call a strategy, {9, c), feasible if it satisfies the drawdown constraint. We 
will see that necessary conditions for feasibility are that r > and rwt > bct 
almost surely for all t > 0. An intuitive explanation for why this is true 
is the following. To be able to sustain indefinitely consumption at a rate 
Ct > bct, the consumption would have to be taken from a source of income 
that is guaranteed, so can only be taken from the interest from the bank 
account. For this to be possible we need to have r > and rwt > bct for all 
t > 0, since the second inequality means that the maximum possible interest 
that can be gained from wealth is at least the minimum amount that must 
be consumed. A proof of this statement is given under Corollary [T] in section 

El 

We begin as one usually does for problems of this type - by defining the 
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value function. In contrast to the standard Merton story, our value function, 
V{-,-), depends on two variables instead of one. Define 



V{w, c) = sup E 

c>bc,e 



-P'U{ct)dt 



Wo = w, Co 



(6) 



Now, let 



Yt 



-ps 



U{cs)ds. 



By the Davis- Varaiya Martingale Principle of Optimal Control [7j, we should 
have that F is a supermartingale for all controls, and there exist optimal con- 
trols (to be found) such that y is a true martingale. In what follows, we will 
use this condition to derive the Hamilton-Jacobi-Bellman (HJB) equation 
for this problem. We will show that there is only one function that satisfies 
the HJB equation, subject to appropriate boundary conditions, and we will 
take this function as our candidate value function and define candidate op- 
timal controls based on this function. In section [5l we will verify that our 
candidate function really is the value function for this problem, and that our 
candidate optimal controls are in fact optimal. 



By Ito's formula 
eP'dYt 



1 



-pV + V^irwt + Otifi - r) - q) + ^a^O^V^^ + U{ct) 
+ Vsdct + V^OtadWi 



dt 



where, for example, Vu, represents the partial derivative of V with respect 
to w. We deduce that for y to be a supermartingale for all controls and a 
martingale under the optimal control, we require 



Vc<0 

and when c = c we must have = 0. We also require 

1 



(7) 



sup 

c>bc,0 



pV + VUrwt + et{p - r) - ct) + ^a^O^V^^ + U{ct) 



0. 



Thus the Hamilton-Jacobi-Bellman (HJB) equation for this problem is 
max I Vc, sup -pV + K,(rw; + 6{fi - r) - c) + \ci^(P'V^^ + U (c) 



0. 

(9) 
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Now, using scaling, we can reduce the number of dimensions of the problem. 
To do this, let A{w,c) be the set of feasible strategies, {9,c), starting from 
initial wealth, w, and initial maximum consumption, c. 



Take A > 0. From the linearity of wealth dynamics we have that 

{9, c) e A{Xw, Ac) <^ {9, c) e A{w, c) 
where (6', c) = {9/X,c/X). Now observe that 



V{Xw, Ac) = sup E 

e,c 

= supE 



I 



oo / „1-R 



1 - R 



(it 



wq — Xw, Co = Ac 



-pt 



V l-R 



dt 



Wo = w, Co 



L-'o 



= A^-'^supE 

6,c 

= A^-^y(w,c). 

Thus taking A = 1/c imphes that 



Wo — W, Co — c 



V{w, c) = c^-^V l) = c^-'^vix) 



(10) 



where x — w/c, and we take the above equation as the definition of v, the 
scaled value function. Note that the feasibility condition mentioned at the 
start of this section now becomes x > h/r. We have 



c-V 



= c-^{{l- R)v -xv'}. 
Substituting the above into the HJB equation gives 

max < (1 — R)v — xv' , 



(11) 
(12) 

(13) 



sup 

y,6<s<l 



-fyu + {rx + 7/(/x — r) — s)v' + -cr^y^v" + U (s) 



(14) 



where y — 9 /c and s — c/c. 

We assume that there is a type of threshold behaviour, which will be verified 
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later. To be precise, we assume that the first term in the HJB equation is 
equal to zero iff x > a and that the second term is equal to zero iff a; < a 
for some a to be determined. The intuitive reasoning for this is that the 
first term is only zero when wc increase c which would only happen if x 
were large. This is because large x means that our wealth is very large 
compared to the running maximum of past consumption, so we have more 
than enough wealth to maintain our current maximum level of consumption, 
so it is in our best interests to raise c and increase consumption from then on. 

Consider the region x < a first, which corresponds to the second term in 
the HJB equation. We can divide this into two maximisation problems. The 
first is 

sup — r)v' + -cP'y^v" 
y V ^ . 

and differentiating with respect to y gives 

y = — 2 — Tf (1^) 

v" 



The second maximisation is 



which has solution 



sup {U{s) — v' s} 

h<s<l 



1 for Za<v' <l 

[^'yi/R for 1 < -y' < (16) 
h for <v'< Zb/r 

where Za and z^jr are constants to be determined. (The reason for this 
choice of notation will become clear when we change to dual variables later 
on.) Here, Za represents the value of v' at which we decide to increase our 
maximum consumption, i.e. Za = v'{a) where a comes from the assumed 
threshold-type behaviour. Similarly, z^jr = v'{h/r) where the ratio h/r comes 
from the feasibility condition. 

Putting this all together gives 

= {l-R)v- xv' for Q<v' <Za 

= -pv + rxv' -\k^^-^ + U{1) -v' for Za<v'<l 

= -fyv + rxv' - + U(v') for 1 < v' < h^^ 

= -pv + rxv' - + U{b) - bv' for b'^ < v' < Zb/r 
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where k = {fi — r)/a and U is the dual function of U, i.e. 



U{y) = sup {U{s) - ys} = 

6<s<l i — It 



where we define R' = 1/R. 



It is perhaps clearer to see what is going on if we rewrite the boundaries 
in terms of x = w/c. To do this, let Xz be the value of x such that v'{x) = z. 
By definition of the value function ([H]), the function v' is a decreasing function 
of X so we can rewrite the above system of equations as: 



= —pv + rxv' — + ?7(6) — hv' for h/r < x < Xj,~i, 

= —pv + rxv' — + U{v') for x^-r < x < Xi 

= —pv + rxv' — + U{1) — v' for a;i < a; < a 

= (1 — R)v — xv' for a < X < oo 



(17) 



An intuitive explanation for what is happening in these regions is as follows. 

First consider b/r < x < Xi^-r, which is the region where x is smallest. 
At X = b/r we have just enough wealth to maintain the drawdown constraint 
if we put all our wealth in the bank account, and consume the interest. As x 
increases until x = x^-r we still consume at the minimum allowed level, be, 
but we have excess wealth which we invest in the risky stock. 

As X increases, we enter the region x^-h < x < Xi. Here our consump- 
tion, c, increases with x until c = c which is the point at which we enter the 
next region. 

For Xi < a; < a, we are consuming at c = c and we keep our consumption 
constant at this level until x hits a certain critical value, a, to be determined. 

In the final region, a < x < oo, x is large, and the optimal action here 
is to immediately increase c until x decreases to a which brings us back to 
the previous region. This ensures that, under this strategy, the set of times 
spent outside the region x G [b/r, a] has zero Lebesgue measure. 

As suggested by the above reasoning, we have several boundary conditions 
at X = b/r. At this value of x, all our wealth needs to be in the bank account 
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to generate enough interest to maintain the drawdown constraint. If we have 
non-zero wealth in the stock, the effect of the Brownian motion means that 
with positive probabihty, x will fall below b/r which would violate the con- 
dition X > b/r which is a necessary condition for feasibility. Thus as x I b/r, 
we must have v'{x)/v"{x) — )• which would imply the amount of wealth 
in the risky stock goes to zero by the form of y given in (IT^ . So our first 
boundary condition is 

^^-^ ^0 as X ; b/r. (18) 
v"{x) 

Now, if we ever hit x = b/r, all our wealth is in the bank account, and the 
interest generated by our wealth, rw, is exactly cancelled by our consumption 
at level be. Hence, our wealth and consumption remain constant, which gives 
the second boundary condition 

v{b/r) = U{b)/p. (19) 

To solve this system of ordinary differential equations subject to the given 
boundary conditions we transform to dual variables 

z = v' (20) 
J{z) = sup {f (x) — xz}. (21) 

x>b/r 

Differentiating the above gives 

J" = -1/v" (22) 
J' = -X (23) 

and the system of differential equations becomes 

= {1- R)J + RJ'z for 0<z<Za 

= -pJ + {p-r)zJ' + ^K^z'^J" + U{1) - z for Za < z < I 
= -pJ+{p~r)zJ' + Ik^z^J" + ij{z) for l<z<b-^ 

= -pJ + (p - r)zJ' + \k^z'^J" + U{b) - bz for b'^ < z < z^/r- 

(24) 

We can also rewrite our two boundary conditions as follows. The first bound- 
ary condition becomes 

zJ"{z) as z ^ zy^jr. (25) 

For the second boundary condition, we need to be more careful. If -Zb/r < oo, 
it becomes 

J[Zb/r) = Zb/r. (26) 

p r 
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If, however, z^yj^ = oo (which will turn out to be the case), we can rewrite 
the second boundary condition as 



X/ N U{b) b 

J{z) ^ + -z 

p r 



—7-0 as z — )■ oo. 



(27) 



In the first region, < 2; < z^,, we can solve for J to obtain 

J{z) = Az^-"^' 

for some constant A. Next, consider the last three regions. The homogeneous 
ODE 

= -pj + (p - r)zJ' + ^kV J" 
has complementary function 

J,{z) = Biz-'' + B2Z^ 
for constants -Bi, B2 and where —a < < 1 < /3 are the roots of 

Q{t) = ]^KH{t-l) + {p-r)t- p. 

By straightforward verification, we can check that the following are particular 
solutions for each region 

+ ^ for Za<Z<l 



Jp{z) 



-^Uiz) for l< z< b-^ 

for b-^<z<z„r. 



for 7m as defined in (jl]). 

Thus the general solution for J is 
(Az^-^' 



J{z) 



for ^ z < Za 
Bz-'^ + Cz^ - ^z+^ for Za< z<l 

r p " — — 

+ Ez^ - for 1< z<b- 

^ Fz-'^ + Gz^ - ^z + ^ for b-^<z< z^/^ 
for constants A, B, C, D, E, F, G, Za and Zb/r to be determined. 



(28) 
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We guess that zi,/r — oo. This makes intuitive sense because z^/r- — v'{h/r). 
If X ever hits h/r then we are stuck at this level, and have no choice but to 
consume at the minimum allowed level from this point onwards. Thus, it 
makes sense that any deviation from this point would be significantly more 
preferable than remaining there, which would give v'{h/r) = oo. Then, the 
boundary conditions ai z — z^/r imply that 



\Fz-'' + Gz'^\^0 asz^oo 



(29) 



and 



\a{a + l)Fz' 



-a-l 



+ 



l)Gz^ 



— >■ as 2; — >■ 00. 



(30) 



The above boundary conditions, together with equality of the function, and 
its first and second derivatives, at Za, 1 and (which is necessary because 
we are using Ito's formula) allow us to determine all the constants as given 
below: 



/3(a + /3) 



M 



Za is the solution between and 1 of the equation 

= (a + /3) (i?(/3 - 1) + l)C.f - + ^ 

r p 



(31) 



A 



B 



,R'-1 



IM 



1-R 



(a + /3)(i?(a + l)-l) 



p r 



1 



RlM 



[l + R{^-l)) 



^l+R(/J-l) 

WW) 



Rr 



1 , , , , a + 1 
{R{a + 1) - 1) — 



M 



G = 



(1 _ ^l--R(a+l)) 

a{a + j3) 



- 1 



RlM 



:i + i?(/3-l)) 
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Thus, we have a function J which is twice continuously differentiable on 
< z < oo. Note that since we have an exphcit form for J we can recover 
the unknowns and Xi using ( 123|) as given below: 



a 

Xf,-R 



-J'{Za) 

-fib-"") 

-J'il) 



(32) 
(33) 
(34) 



We can take the dual of J to recover v as follows 



v{x) = inf {J{z)+xz}. 

0<2<OO 



Unfortunately, for < 6 < 1 it is not possible to obtain v explicitly in all 
four regions, but we can obtain v explicitly for two of the four regions: 



l-R* 



[aF)^* + for h/r < X < x^- 



ViXj 



U{x) 



-A{l-R') 



-1/R' 



(35) 



for a < X < oo 



For the inner two regions, x^-r < x < Xi and Xi < x < a we have to obtain 
V numerically. 



In the next section, we will show that for 7^ 1 



V{w,c) 



v{w/c) 



(36) 



is the value function for this problem and that the optimal controls are given 

by 

f^-rV^ (37) 
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and 



'be for b/r < w/c < Xf,-R 

iVw)~^^^ for Xh-R < w/c < xi 

c for Xi < w/c < a 

^w/a for a < w/c < 00. 



{31 



We illustrate the optimal strategy and the effect of the drawdown constraint 
via several figures. 



In Figure [T], we plot the dual function, J, and the scaled value function, 
V, as well as the optimal controls, 9 and c, all against x. 
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In Figure [21 we provide a simulation of the stock price followed by plots 
of X and the optimal controls, all against time, based on this simulation. 
The horizontal dashed lines in Figure [2b] represent the critical values b/r, 
and a which give the boundaries of the four different regions of 
behaviour. As x moves between these different regions, we can see the effect 
on the optimal consumption rule in Figure [2d| In the simulation, consump- 
tion initially varies with x, then as x increases, consumption is maintained at 
level c. As x increases further, c is occasionally raised to keep x < a. Finally 
as the stock price plummets, x falls as well, so consumption drops until it 
hits be and is maintained at that level so as not to violate the drawdown 
constraint. 

Figure [3a| shows the scaled value function, function of x for several 

values of b. We clearly see that v decreases as b increases, because increas- 
ing b tightens the drawdown constraint, which in turn restricts the class of 
feasible strategies. Finally, Figure [3b] plots v{x) as a function of b for several 
values of X. In this plot, we see once again how increasing b decreases the 
value of f (x), as one expects. 

4 Identifying the optimal controls and the 
value function for R = 1 

Now, we consider CRRA utility for = 1, that is we take our utility func- 
tion to be U{x) = logx, and solve the HJB equation in this case. The main 
difference is that we have a different scaling result. As before, let A{w, c) be 
the set of feasible strategies, {6, c), starting from initial wealth, w, and initial 
maximum consumption, c. 

Take A > 0. From the linearity of wealth dynamics we have that 
{9, c) G A{\w, Ac) <^ {9, c) G A{w, c) 
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(a) Dual function, J, against z (b) Scaled value function, w, against x 




(c) Wealth in stock, 0, under the (d) Optimal consumption strategy, c, 

optimal control, against x against x 

Figure 1: The vertical dashed lines represent the critical values 6/r, 
and a which give the boundaries of the four different regions of behaviour. 
For both graphs we take h = 0.7, co^2,R^2,p^ 0.02, r = 0.05, a = 0.35, 
and // = 0.14. 
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(c) Wealth in stock, 9, against t (d) c, c, &: be against t 

Figure 2: The above shows a simulation of the stock price and plots of x and 
the optimal controls, 6 and c, against time, t, based on this simulation. In 
Figure [2bl the horizontal dashed lines represent the critical values b/r, Xh-R, 
Xi, and a which give the boundaries of the four different regions of behaviour. 
For all three graphs we take b = 0.7, Cq = 2, R = 2, p = 0.02, r = 0.05, 
a = 0.35, and /i = 0.14. 
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10 15 20 25 30 35 



(a) Scaled value function, v, against x for several 
values of b 




0.4 0.6 
b 



(b) v{x) against b for several values of x 

Figure 3: In the above we take cq = 2, R = 2, p = 0.02, r = 0.05, a = 0.35, 
and fi = 0.14. 
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where {9, c) — {0/X, c/A). Now observe that 



V{Xw, Ac) = sup E 

e,c 

— sup E 

9,c 

log A 



e~^* log ctdt 



Wo — Xw, Co = Ac 



e-P^log{Xct)dt 



Wq — W,Co — c 



p 

log A 



+ supE 

e,c 

+ V{w, c) 



e'^logctdt 



Wq — W,Co — c 



Thus taking A = 1/c implies that 



V{w,c) = V + = v{x) + 

V c / p 



logc 



(39) 



where x — w/c, and we take the above equation as the definition of v. We 
have 



(40) 
(41) 



= 


C-V 




C-V 







1 

XV 

p 



Now switch to dual variables, as we did before. Let 



z — V 



J{z) — sup {v{x) — xz}. 

x>b/r 



(42) 



(43) 
(44) 



Apart from this, the analysis is exactly the same as in the previous section, 
so wc omit the details and present the final result. Our solution of the HJB 
equation for log utility is of the form 



'-Hogz + A 



J{z) 



Bz- 



Cz^ - ^z 



Dz-^' + Ez^ -)^{\ogz + l)-^{p-r 2 
Fz-'^ + Gz^ -^z+'-^ 

r p 



for < Z < Za 
for Za < z < 1 
^K^) for l<z< 1/b 



for l/b < z < oo. 

(45) 
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for constants A, B, C, D, E, F, G, and Za as given below. 

{b^ - 1) 



C 



f3{a + f3) 



a a + 1 
p r 



Za is the solution between and 1 of the equation 



= + p)Cz^ h - 



+ 



D = B + 



a{a + (3) 



r p 



E 



a a + 1 
p r 



B 



(&-° - 1) 
a{a + (3) 



p r 



Za 


a 


Za 


^ log Za 


r 


P. 


r 


P 



G = 0. 

And as in section [31 we can recover a, x^-fl, and Xi as given below: 



a 

Xi 



-J'{za) 
~J'{l/b) 



(46) 
(47) 
(48) 



We can take the dual of J to recover v as follows 

v{x) = inf {J{z)+xz}. 

0<z<oo 

As in the R ^ 1 case, it is only possible to invert J explicitly in two of the 
four regions, as given below. 



, 1--R* 



V[X] 



l-R* 



p^R' ^]ogb b/r <x< xxjh 



(49) 



^ (log a; + 1 + log p) + A for a < a; < oo 
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For the inner two regions, Xi,-r < x < Xi and Xi < x < a we have to obtain 
V numerically. 



In the next section, we will show that for R = 1 



V{w, c) = v{x) + 



logc 

p 



(50) 



is the value function for this problem and that the optimal controls are given 

by 



and 



e 




'be 


for 




for 


c 


for 




for 



a2 K„ 



"1/6 



(51) 



(52) 



5 Verification argument 

We modify the argument of Dybvig |9] to prove optimality for our conjec- 
tured solution. First, we obtain necessary conditions for feasibility - that 
is, we must have rwt > bct almost surely and r > 0. In what follows, let 
E^[-] = E[-|Jv], where {J^t)t>o represents the filtration generated by the stock 
price, S, or equivalently, by the Brownian motion, W. 

We will need the following lemma. 
Lemma 1. 

For all feasible strategies, and for all r > 0, 



E^ 



(tCt 



dt 



< Wr 



almost surely, where (t = exp(— rt — -^kH — kWi) is the state-price density 
and where k, = as defined previously. 

Proof. (Ct)t>o is a strictly positive process and by Ito's formula, 

dCt = U-rdt- KdWt). 

Define for t > t 



Cr Jr (r 
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By Ito's formula, 

dZt = '^dt + y- {wtrdt + Otiiii - r)dt + adWt) - Ctdt) 

Sr St 

+ ^ {-rdt - KdWt) + J- {-KOta) dt 

St St 

= ^ {aOt - nwt) dWt. 

ST 

Hence, Z is a positive local martingale which implies that Z is a supermartin- 
gale. Finally, using Fatou's Lemma gives 

CsCs 



L 



CsCs 

S=T Ct 



ds 



< Urn Er 

t—^oo 



< lim 

t—>oo 



=r C 
* CsCs 



-ds 



-r Cr 



ds + 



CtWt 
Cr 



lim Er[Zt\ 



< Zt since Z is a supermartingale 



□ 



Using this lemma, we obtain the following corollary which gives necessary 
conditions for feasibility. 

Corollary 1. 

For the Merton problem with a drawdown constraint on consumption to have 
a solution, we require r > and we must have Wr > — almost surely for all 
T > 0. 

Proof. Fix T > 0. From the previous lemma and the drawdown constraint 
we have 



Wt > Et- 



> E, 



-L 

-L 



CtCt 



t=r Cr 

~ Ctbc. 



dt 



t=T 



Cr 



dt 



E, 



exp 



-r--K^]{t-T)-K{Wt-WT) 



bCrdt 



exp{—r{t — T))bcrdt 



t=r 
bcT 



for r > 

T 

+00 otherwise 
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where the exchange of the order of integration and expectation is vahd be- 
cause the integrand is non-negative. □ 



This makes precise the intuitive argument given earher about why we can 
restrict our attention to the feasible region {{w ,c) : w / c > h / r} . For our con- 
jectured optimal controls ((EZ]), fl55]) or f l5T]) . fl52]) ). we can further restrict our 
attention to the region {{w,c) : h/r < w/c < a}, because our consumption 
rule ( (138|) or (152|) ) implies that the set of times spent outside this region has 
zero Lebesgue measure. 

We are now ready to state our verification theorem. Note that we take 
Co > 0. As mentioned in Dybvig [U], we could take Cq = without too much 
difficulty. However, this would only yield a slight increase in generality but 
would require dealing with many extra cases. 

Theorem 1. 

Given fixed initial conditions (t^o, cq) with wq/cq > h/r and cq > 0, the Mer- 
ton problem with a drawdown constraint on consumption has value function 
V{w,c) as defined in fl5B|) or fl5U]) . The optimal controls are 

^-r Vyj 
^ ' WW 

and 



'bct 


for 


b/r < Wt/ct < Xb-R 




for 


Xb-R < Wt/Ct < Xi 


Ct 


for 


x\ < Wt/ct < a 


wt/a 


for 


0. < Wt/Ct < oo. 



for constants a, Xb-R and Xi as defined in f l32|) . fl33l) . fl34l) . or fH6|) . P7|) . 

m- 

We will prove this via a series of lemmas. We will need the following defini- 
tion. 

Definition 1. We say that a process X is a local supermartingale if there 
exists a sequence of stopping times r„ with r„ oo almost surely, such that 
for each n > we have that {Xt/s^rn)t>o is a supermartingale. 

Remark 1 . Clearly, if Xt = Mt + At for M a local martingale and A a non- 
increasing process, then X is a local supermartingale. 
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Lemma 2. 

Let 



Yt= [ e-P'U{cs)ds + e-P'V{wt,Ct). 
Jo 



Then for any feasible strategy, {0,c), Y is a local supermartingale and for the 
proposed optimal control, Y is a local martingale. 

Proof. This is essentially true by construction because we chose V to be the 
solution of the HJB equation. However, there are a few things left to verify. 
We need to check that Vc < 0, > and < to ensure that the drift 
term in the Ito expansion of Y is non-positive for all feasible strategies and 
is identically zero for the conjectured optimal control. By the definition of J 
in ([21]), it is sufficient to show that (1 - R)J + RJ'z < 0, J' < and J" > 0. 
This is a straightforward but surprisingly tedious exercise and we omit the 
details. □ 

The next step is to strengthen the conclusion of the above lemma from local 
(super) martingale to (super)martingale. To do this, we first need to prove a 
result about the wealth process, {wt)t>o. 

Lemma 3. 

Fix Co > and p 0. Given any feasible strategy, {9, c), we have 
w'l = Wgcxp I / p I r + — (/i - r) - — + i(p - 1) [ — ) a"^ \ ds 

ls=0 \ "^s UJs 2 \Ws 

X exp I r p^adWs -- f p'i —Xa^ds 1 (53) 

where the second exponential term is a stochastic exponential (or Doleans- 
Dade exponential) which is a non-negative local martingale thus a super- 
martingale. For the proposed optimal control, this stochastic exponential is, 
in fact, a true martingale. Furthermore, for the optimal control, there exists 
a constant b depending on p and the parameters of the problem such that 

E[wf] < wgexp(k). (54) 

Proof. Ito's formula tells us that dlogi^w^) = ^dw — \-^d{w). Note that 
Ito's formula is valid because the logarithm and power functions are smooth 
over the relevant domain since feasibility implies that Wt > bco/r > be- 
cause Co > by assumption. Integrating the expression for dlog^w^) and 
substituting in the wealth equation ([1]) gives the form for in (l53l) . 
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An application of Ito's formula gives that the second term in flS5]) is a lo- 
cal martingale. Since it is clearly non-negative, it is a super martingale. To 
show that this is a martingale for the conjectured optimal control, it is suf- 
ficient to show that 9s/ Wg takes values in a compact set of the form [0,M] 
for some constant M > 0. This would imply that Novikov's criterion (page 
198, [12]) is satisfied which would imply that it is a martingale. We have 
that — = ^ X — . As mentioned before, for the coniectured optimal con- 
trol, Xs = Ws/cs takes values in the compact set [b/r,a] which implies that 
Cg/ws e [l/a,r/b]. Now, to deal with the 9s/cs term, first we will show 
that for the conjectured optimal control, it is a continuous function of x for 
X G [b/r, a]. For 1 and R=l,we have by ([15]), ([201) and ([21]) that 

9s fJ^-r _ ^„ 



Cs 0-2 



zJ". 



This is continuous for x G (6/r, a], or equivalently z G [za, oo), since by 
construction, J" is continuous in this region. So the only thing to check is 
continuity at a; = b/r. At this critical value of x, we set ^ = and place all 
our wealth in the bank account, so we need to check that 6' — )■ as x J, 6/r. 
By the above equation, this is equivalent to checking that zJ" — )■ as 2; f 00. 
But for z > b~^, we have 

zJ" = a{a + l)Fz-"~^ ^ as 2 ^ cx) 

as required. Thus, 9s/ Cs is a continuous function of x for x G [b/r, a] and 
since x takes values in a compact set, we have that 9s/ Cs takes values in a 
compact set of the form [0, M] for some constant M > 0. Thus, we have that 
9s/ Ws G [0,M] for some constant M > as desired. Hence, by Novikov's 
criterion, we have that the stochastic exponential is a true martingale. 

Finally we need to prove the stated bound on E ^ . We just showed that 

9s /ws takes values in a compact set of the form [0, M] but a similar result is 
true for cJw^. Indeed, observe that — = ^ x —. The first term is clearly 

*' * ' Ws Cs Ws •' 

bounded between and 1, and we showed above that the second term takes 
values in a compact set. Because of this, the integrand in the first exponen- 
tial in ( 153]) is bounded and if we let b be an upper bound for it, (15^ follows 
by the martingale property of the second term (the stochastic exponential) 
in (151. □ 



With the above result in hand, we can strengthen the conclusion of Lemma 
Elto: 
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Lemma 4. 

Fix Co > 0. Let 

Yt= I e-P'U{cs)ds + e-P'V{wt,Ct). 



Then for any feasible strategy, {0,c), Y is a supermartingale and for the 
proposed optimal control, Y is a martingale. 

Proof. For any feasible strategy, Lemma [2] implies that F is a local super- 
martingale. It is enough to show that Y is bounded below, because it is easy 
to see that any local supermartingale bounded below is a supermartingale. 
Note that the fact that > (see proof of Lemma [2]) together with the 
boundary condition (HM implies that 

V{wt, ct) > V (—, ct] = U ihct) Ip > U{bco)/p > -oo. 



r 

Hence, V is bounded below. To show that Y is bounded below, observe that 
Yt= [ e-''U{c,)ds + e-^'V{wt,Ct) 





> [ e-P'U{bco)ds + e-^'U{bco)/p 
Jo 

U{bco) 



P 

which gives that F is a supermartingale. 

Now consider the proposed optimal control. We know from Lemma [2] that 
y is a local martingale under this control. To show that y is a martingale, 
it is enough to show that 

E{Y)t < oo 

for all t > as this implies the local martingale Y is in fact a true martingale 
(see Corollary 1.25 in [21]). We have that under the conjectured optimal 
control 

dYt = e-P'VJMWt 
where Ot = —^^^^ (for both 1 and R = 1) hence we obtain 

dYt = -Kc-P'-f^dWt 

* mm 
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where k = as defined previously. First recall that (for both R ^ 1 and 
R = l) 

*^ WW ^ ^ 

J" = 1/v" 
J' = -X 
z = v' 



hence 



y2 ^-2R( J\2 

— — -C^^^Z^J" 



''WW ^ ^ 

Now, under the conjectured optimal control we have Za < z < oo, and z'^J" 
is continuous in this region by construction. For Za < z < b~^, z^J" is 
bounded, since a continuous function on a compact set is bounded. For the 
final region, < 2; < oo, we have 

^2 J" = a{a + ^ as z ^ 00 

because —a < 0. Hence, z'^J" is bounded on b^^ < z < 00 as well. So z'^J" 
is bounded on the whole interval Za < z < 00, say 

\z\j"\ < K 

for some constant > 0. We have 

d{Y)t = e-^'"K'c^^^-''\z^J"fdt 

which gives 

E(F)i = E [\-''P'K%^^'-''\zM"Yds 
Jo 

Jo 



(55) 



where the use of Fubini's Theorem is justified because the integrand is posi- 
tive. 

Recall that we require R > R*, as explained in section [21 which gives us 
the three following cases. 
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R* <R<l:We have 

_ rw., 
c, < 



b 

from the feasibihty condition in Corollary [H This implies that 



which gives 

< (^) ^ ^ Wo^^~^^ exp(6s) 

using the bound given by ( 154|) taking p = 2(1 — _R). Substituting this 
into gives 

< oo. 

-R > 1: We have that c is an increasing process and Cg > by assump- 
tion. Thus 

.2(l-i?) < .2{l-iJ) 

Substituting this into gives 

Jo 



-2^2-2{l-_R) 
< OO. 



i? = 1: In this case, ( 13^ becomes 



E(r)t < fsT^K^ / Ids 

= K^kH 
< oo. 

In all three cases, E(y)t < oo for alH > which implies that y is a martin- 
gale under the conjectured optimal control. □ 
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As a final step, we now address the asymptotic behaviour of the residual 
term K[e~^^V{wt,Ct)]. This is essentially the argument given in Lemma 6 in 
Dybvig [9J. 

Lemma 5. 

Fix Co > 0. For all feasible strategies 



liminf E[e-^*\/K,Q)] > 0. 

t—>oo 

For the optimal control 

lim E[e-P'V{wt,Ct)] = 0. 



t—^oo 



Proof. Note that the fact that V^, > (see proof of Lemma [2]) together with 
the boundary condition (|T9i) implies that 



V{wt, q) > \/ ( — , Q ) = f/ /p > U{bco)/p > -oo. 



Consequently, 

liminf E[e-''V(u7t,Ct)] > lim e-'''U{bco)/ p = 0. 



t—^oo t—^oo 



Now, for the conjectured optimal strategy, we will consider the cases R > 1, 
R = 1, and R* < R < 1 separately. For i? > 1, we have J(0) = hence from 

v{x) = inf {J{z)+xz}. 

we deduce that v{x) < for all x > b/r, which implies that V < hj (1361) . 
But we just showed that 

limmiE[e-P^V {wt,ct)] > 

which forces 

lim Ele-P'Viwt, q)] = 

t— ^-oo 

for the conjectured optimal control. Now for R = 1, using the boundary 
condition given in f lT9|) and the fact that \4 < 0, we have 

V{w,c) >V (w, — ) 



b J 

U{rw) / p 

-(log w + logr) 
P 

28 



which gives a lower bound for V. Also, recall that for x = ^ > a we auto- 
matically increase c until x = a. Thus, for c < w/a, V{w,c) = V{w,w/a). 
This together with the fact that Vg < implies that 



(w 
w,- 
a 



= - (log w + l + \ogp) + A 
P 

where the final equation is by (H9|) and (l50l) . Hence, to show that 

E [e'fWiwt, ct)] ^ as t ^ cx) 
it is enough to show that 

E [e"''* log wt] -> as t oo. 
Taking the logarithm of (153|) for p = 1 gives 
E [e-^*logWt] 
= e-^*(logwo) + e-''*E 







r + —[p-r) — 

w., 2 \w. 



a 



ds 



+ e-''*E 



—adW. 
< e"^* ( logwo + E ^ 



r + 



2a2 



ds + 



-adW, 



Ws 



where the quadratic form {p ~ '^)^ ~ ^ (^) replaced by its largest 
value (/i — r)^/2(T^ and — was replaced by 0, a lower bound. Thus 



E [e-P^ log Wi] < e-P* \ \ogwo + E 

= e~P* ^log + 
— )■ as t — oo 



L^o 



2(T^ 



c/s+ / —adW, 





2a2 



where — bounded (see proof of Lemma Ej) implies that E 



Jo 



a'^ds 



< 



oo and therefore we have E 



Jo 



adW, 



0. 
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Finally for i?* < i? < 1, by the same reasoning, 

V{w,c)>v(wJ-^) 
= U{rw)/ p 

^ P(i - R) ■ 



We also have 



V{w,c) < V (w,^^ 



U{w) 
1-R 



-A{l-R')_ 
1 

- R') 



-l/R' 
-1 -l/R' 



where the first equality is by and Hence, to show that 

E [e-''V(wi, ct)] ^ as t ^ oo 
it is enough to show that 

E [e-P^w]-^] -> as t ^ oo. 
Taking p = 1 — R'm. (153|) gives 
E [e-P'w]-''] 



exp 



(l-i?)|r + ^(/.-r)-^-|f^ 



a 



p ds 



X exp / (I- R)—adWs - - 
w., 2 





exp 

t 



[1-Rf 



w. 



a ds 



K 



:i-R)[r + ^]-p]ds 



expf [ {l-R)^adWs-l [ (1-^)' 
\Jo 2 Jo 



a ds 



where the quadratic form (/i — r)|p — (wt) replaced by its 

maximum value (/x — r)'^/2a'^R and ^ was replaced by 0, a lower bound. 
Thus 

E [e-P'w]-^] < wl-^ exp (- ( P - (l - R) ( r + ^)) t 



= wl ^exp{-R'jMt) 
— )■ as t — oo 
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since the stochastic eponential is a supermartingale thus has expectation less 
or equal to 1 and because 7m (defined in (jl])) is strictly positive by assumption 
(see section [2]). 

□ 

We are now finally ready to provide a proof of the verification theorem, 
Theorem [H 

Proof of TheoremUi To prove optimality, we need to show that for the op- 
timal control 



E 



P'U{ct)dt 



t=o 



V{wo, Co 

and also that for any other feasible strategy, {6, c), 

V{wo,c^)>¥. / e-P'U{ct)dt . 
Jt=o 

From Lemma HI we have that for the optimal control, y is a martingale which 
gives 



V{wo, Co) = Fo 

lim ¥.[Yt] 



t—>oo 

lim E 

t—>oo 

lim E 

t— >oo 



E 



[ e-''U{cs)ds + e-'''V{wt,Ct) 

.Js=0 



L"'s=o 



+ limE[e-^V(w7t,Q)] 



t—^oo 



'^'U{Ct)dt 



lJt=0 



where exchanging the order of the expectation and the limit is justified by 
U{cs) > U{bco) > — oo. We also used the result limj_^oo E[e"^*y(wt, Ci)] = 
which was obtained in Lemma [51 



To complete the proof observe that by Lemma HI for any feasible strategy, Y 
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is a super martingale, hence 



V{wo, Co) = Yo 

> lim E[Yt] 



t—^oo 

lim E 

t—^oo 

lim E 

t—^oo 



e~''^U{cs)ds + e-''V{wt,Ct) 



L"'s=o 

t 



e-P'U{cs)ds 



U 3=0 



+ lim ^e-P'V{wu ct)] 



t—>oo 



> E 



-P'U{ct)dt 



lJt=0 



where exchanging the order of the expectation and the limit is justified by 
Fatou's lemma (or because U{cs) > Uipco) > — oo), and we used Lemma O 
to obtain hmi_j.oo E[e"''*V(wt, q)] > 0. 



Hence, we have shown that our conjectured solution is optimal. 



□ 



6 The problem is ill-posed for R < R* 

In the standard Merton problem [TB], one observes that for R < R* (for 
R* as defined in ([5])), it is possible to find strategies that give the investor 
infinite expected utility. We observe the same scenario in the case we consider 
here. The Merton problem with a drawdown constraint on consumption is 
well-posed if and only if R > R*. In the previous section, we presented and 
verified the optimal solution for R > R*. Now, for completeness, we will 
demonstrate a class of strategies that give infinite expected utility if we take 
R < R*. 

Proposition 1. For R < R* , the Merton problem with a drawdown con- 
straint on consumption is ill-posed. That is to say, it is possible to find in- 
vestment and consumption strategies that give the investor infinite expected 
utility. 

Proof. We want to show that for R < R* , we can choose our investment and 
consumption strategies to make our investment objective 



E 



-''U{ct)dt 



infinite. We will choose controls such that consumption is non-decreasing. 
This corresponds to taking 6 = 1 in the drawdown constraint, and such a 
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strategy would then clearly work for any < 6 < 1 as well. 



Let 6t = -Kuiwi f-) where Wt = maxo<s<tWs, and ttm = fi^ is the 

so-called Merton ratio. This is similar to what we see in the standard Mer- 
ton problem [16], where the optimal investment strategy is to invest t^mWi 
in the risky stock, for txm as just defined. 



In terms of consumption, let q = \wt for A > which we will specify 
later. Substituting this into our wealth equation ([1]) gives 



dwf 



R 



r + — ]dt+ —dWi 



R 



where k = as defined previously. We want to get an explicit solution 
for Wf because this will enable us to calculate our investment objective. To 
do this, we will use the following argument by Cvitanic and Karatzas in 
From the above SDE, we obtain 



diwt- 



r + ^j dt + ^dWt 



For convenience, let a = A/r and define 



A 



dWf. 



Wt = {wt - awt) wl " . 



By Ito's formula 

a a j 

dwt = {wt — awt)dwl'" + Wf'"d{wt — awt) + d (wt — awt, wl 



but the last term is zero because wl " is increasing so has finite variation. 
Hence we obtain 



dwt = (wt - awt) 



aWt 



l — a 



-dwt 



+ wl 



[Wt - awt 



R 



r + —]dt+ —dWt 



R 



[wt - awt)wl ° 



K 



R 



r + —\dt + —dWf 



R 



— adwt 
1 



+ 



awl'" 
l — a 



■[{wt- Wt)dwt] 



and the last term is zero by the definition of Wt- Therefore, we get 

,2- 



dwt = Wt 



K 



R 



r + —]dt + —dWi 



R 
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which does not depend on a. We can solve the above SDE exphcitly to get 

,2^ 



i_ 

t&f = (1 — ajwg"" exp 



r + 



R 



K , 



where we let our initial wealth be wq- From the definition of Wt, we have 
that 



max Wg = {wt — awt)wl ° = (1 — a)wl~ 

0<s<t 



(56) 



Define 



and denote 



Yt = exp 





R * 2i?2 



= max Yg. 

0<s<t 

Then we can rewrite Wt as 

Wt = {I — a)wQ~"e 



and so 



max Wg 

0<s<t 



(57) 



since we will choose A so that 1 — a > 0. Equating ( 1561) and (!57j) gives 
We want to calculate our investment objective which is 



E 



e~'''U{ct)dt 
e-P%U{Xwt)]dt 



-pt 



> 



1-R 



E [w]'^) dt 



pt+(l-Q)(l-i?)(r+%jijg 



Y 



dt 



-pt+(l-a)(l-R)(r+^)i 







1-R 



dt 



since E 



> 1. This is because Yt > 1 almost surely and we have 



1^1 — a)(l — -R) > because the feasibility condition 

rwt > 1 X ct ^ rwt > Xwt =^ Wt > awt 
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implies that we must have < a < 1, and since R < R* < Ihy assumption, 
we have that 1 — i? > 0. 



Now since R < R* or equivalently ■jm < (see (j4j)), as explained in sec- 
tion [21 we know that 



K 



p+{R-l)[r + —] <0 



which implies that 

-p + {l-a){l-R) (r + 
so we have 



— > (1-R){ ar 

R ' \2R R 



E 



-P'U{ct)dt 



> 



(Awo) 



l-R 



R 



2 2 



dt. 



Recall that a = X/r. The right-hand side of the above inequality is infinite 
for 

< ar 

2R R 

^ 0<— -A1 + — 
2R \ rR 



^ < A < 



rK 



2rR + 2K^' 



And one can check that for this choice of A we do not violate the condition < 
a <1 mentioned above. Therefore, taking A in this range allows the investor 
to obtain infinite expected utility which shows that the Merton problem with 
a drawdown constraint on consumption is ill-posed for R < R*. 

□ 
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